Search AI Products and News

On March 13th, Sesame unveiled its latest speech synthesis model, CSM, attracting significant industry attention. According to the official introduction, CSM adopts an end-to-end Transformer-based multimodal learning architecture. It understands contextual information to generate natural and emotionally rich speech with stunningly realistic sound. The model supports real-time speech generation, processing both text and audio inputs. Users can also control features such as tone, intonation, rhythm, and emotion by adjusting parameters, showcasing high flexibility. CSM is considered a breakthrough in AI speech technology.

At today's 2024 Volcano Engine AI Innovation Tour, in addition to the video generation model, ByteDance also launched the Doubao Music Model and Doubao Simultaneous Interpretation Model, announcing significant upgrades to the Doubao General Model Pro, Text-to-Image Model, Speech Synthesis Model, and other specialized models. The introduction of the Doubao Music Model signifies Volcano Engine's deep commitment to the field of music creation. Supported by powerful algorithms, this model enables high-quality music creation freely. For lyrics generation, it can quickly generate emotional lyrics based on just a few simple input words.

Bilibili UP主 'XiaoChongGe_' released a fan-made video of Genshin Impact, featuring character imitation of Frowning Na, retaining the original voice, with over 1.36 million views. The creator used the VITS speech synthesis model to upload voice text and extract language features, preserving the unique vocal characteristics of the Genshin Impact character. AI voice cloning technology has become widespread, with tools like HeyGen and AI Dubbing lowering the barriers to entry. The upgrade of AI technology has attracted the attention of creators, emphasizing the importance of producing unique works in both content and form. The article discusses the principles of the VITS model and briefly explains speech synthesis.